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ABSTRACT 

Teaching and learning activities that occurred m 
large university classes were studied with attention to the extent 
students are being involved and whether that involvement makes a 
difference in their attitudes and performance. At the University of 
Texas^ at Austin, 19 large (100 students and larger) classes, 
representing the college of ifberal arts, natural sciences, 
engineering, and business, were studied. Each class was observed at 
least once a week for one semester. A trained observer recorded the 
verbal interactions using the ExpanBed Cognitive Interaction Analysis 
System. The observation data were analyzed to determine whether 
differences occurred in the teaching techniques used in different 
disciplines or by different instructors. Students also ranked 
instructors according to their effectiveness. Findings include the 
following: students rated instructors more highly who tested at 
higher cognitive levels (e.g., gave essay exams); instructors who 
relied heavily upon visuals were rated lower than those who used them 
only at strategic points; all of the instructors lectured an average 
of 80-95 percent of each class session r and there was more student 
talk\per instructor question in the higher-rated classes. Afj^endices 
provide numerous statistical tables and graphs of the results. 
(SW) . 
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What Really Happens in' Large University Classes? 



Abstract 



Economics are currently dictating the use of large classes /:aught by a 
single""nsructrr%a"ther th'an smaller'multiple sections of the same course 
taught by several instructors. The increasing use of these large classes has 
brought up a number of pedagogical questions: 

1. What teaching techniques are currently being used by instructors who 
teach large classes? 

2. Which teaching techniques are percieved as most effective by the 
, students who take these classes? 

3. What teaching techniques are utilized by instructors who require their 
students to think and perform at higher cognitive levels?. 

In this study 19\large (100+ students) classes from the colleges of Liberal 
A?ts Natural SciWes, Engineering, and Business at the University of Texas at 
Austin were studied in-depth to determine what happens in these classrooms. 
Each Clals wis observed at least once a week for one semester. During each 

effectiveness (from the students' point of view). 
Several of the most interesting findings are: 

1. Students rate instructors more highly who test at higher cognitive 
levels (e.g., give essay exams). 

2. Instructors who rely heavily upon visuals are rated lower than those 
who use them only at strategic points. 

3 All of the instructors lecture an average of 80-95% of each class 

session while students participate an average of only 5% of the time. 

4. There are more purposful uses of silence in the classrooms of 
higher-rated instructors. 

5. There is more student talk per instructor question in the higher-rated 
classes. 

6 The most frequentjly asked questions in all classas were either 

rhItoHcal or process related (e.g., "Does everyone have a copy or the 

handout?"). 

^—^^^^ findings and suggestions for further-research are contained in - 
the paper which follows. 



What Really Happens In Large University Classes? 



Introduction 



nwor thP vpars there has been a great deal of discussion concerning the 
type ea i'nrChifh occIl"s in the 3ery large classes which are becom ng o 

e i;^??ng^^ira?^ 

?Ss Sarrier s being lowered somewhat as more emphasis s being placed- on the 
Thouqh researchers have Indicated that a variety of teaching methods . 

rsS="ere L^^^^^^^^^^^^ 

1 They get right down to business. 

1: ISfy Sn'a 'vartetrof'i'nltructional strategies. 

4. They stay with their, subjects. - * . 

5. They use humor. 

5 They have command of their classes. 

7 Thpv interact with the students. 

^Sive i-nSediate response to student question or answer, 
b. Provide corrective feedback. 

- 5* s?!i?rco??e2raS;^^^^^^ 

n e!! an explanation of .why the answer was correct). 

8 Provide a "warm classroom climate. 

a. Students free to interrupt at any time. 

b. Spontaneous introduction of humor. 
9. Nonverbal behavior. " 

a. Use gestures frequently. 

b. Walk around as they talk. 

c. Extensive iise of eye-contact. _ 

l^^^Z «es S ^?r;^«;?«in^??n.ished 



v 



. . „f ,h. Masses observed Is unknown: It , is mentioned that 
;2;r«f rfni,rculsls''weJS%e:ini" SSt%o defimte numbers are given. , 

Most of the studies which have ^^J-.^f "/.rbrn ru-arufd by"" 
.^.T.l^f^\X"X^l"rf r.i^l'.'o^'lV^ll ^sfze. At the end of this 
review McKeachie concludes that 

??sir;jrused 

rr 1tlr?on! Shen other objectives -ej"-- 
. • brth"s di r'a;d% uuy members feel^^ - 

educa.iona goals. n 9^^^^^^' detention of knowledge. 
Trrtlclf iMnJ^nr-d^artftSd: Change (p.27). 

on the other hand, Connor (1977 ) -iewed the^ research eviden^^^ 

effectiveness of various methods of teaching^^ ^^^^^^ 
: concluded that .the size of the class^neea no^ teaching/learning process can be 

effectiveness of teaching. He stated that the teacm^ ^^^^^^^ procedures 

, fniivi dualized and learning can be done "depjjjf^^y ^^^^^^ .,hieh is the most 

are used. There is, however, no single instru"io ^^^^ severaT 

Iffective for all situations a"d a 1 subjects, his ^ 

studie- which report that students attitudes towara ^g^ ^^^^^^ ^^^^^^^ 

necessarily influenced by t^.e J^^^f.^f "a;!" ' ups. 
the ability of the instructor to handle large gro p 

• stuoent attitudes- toward larj classes were also studieJ^byJ^ooreJ19M 

She found that student J^/p^esentatian fr?m class per'od to class 

If the instructor varies ^J^^Juctional and student objectives. In the 

period and establishes ^set of instruct ona ^^^^^ that the 

Large Class Analysis Project ^^^^ ^ classes in which the 

s^ulenls-gave-TiTgTier -ratings for earning/ enjoym .^^ ^hat . 

instructors tested at higher cognitive leve^ JSgntive processes enjoy their 
students who are 

courses more and, consequently, are more.mui. 

Handling large^groups and e^^^^ 
the focus of a number of '"°''%;^?^?J,^J"e? "1979! Hunsaker & Roy, 1977; and 
1983; Haber, 1979; Stanton, Cornwell 1^/^, interested in doing more 

Bell & Lewis, in progress), instructors na students parrot it back on 

than just diUeminatingMnformation aad Javing. the stud^ts.p^^^ 

the exams. They want students to learn ^.^ ^^^^5 (usually 5-8 

dividing their large classes into small study/wom ^^^^^^ deye opment 

studenti each) they, are fading that they are ao, possible in a 

of problem-solving and "^^n cation ski wni^ j addition, the students 

total-lecture or typical lecture-discussion rorm igg^ning; they have to 

in these classes become f '•^.^"P^/^;'^ ^hercom^^ to class or -they won't know 
do the readings, problems, etc. before tney cu 
what is going on. 



wales and Nardi (1981) P--" J° ^^^^ s^^^^^^^^ tLching. 

Benjamin Bloom (1980) as "'sans by which intelligence, 
even in crowded classrooms. The e four vaHab^ appropriate 
Testing, and Personality. It ^as nypo^nesi^e influence student 

nianipulation of these I'our variables would po id ^^^^ ^ 

success. The first variable, ^^f^^' """f?Ln'^%tates that this time can be 
spends learning o^^side of class Bloom (1^^ states tn^^^^^^^^^^T materials 
dramatically increased by improving the ^"^nLy o ^^^^g ^o guide the 

(e.g.. text appropriate to the "^eds of the student, oojec^^^^^ 
students' study, and handouts whch "^^^^I^^^^.^^i^i^IqeSSe 'deals with the 
students to paster). The second varabe^ 
cognitive entry characteristics ^hicli s^^^ 

concepts. This means that the Instructor wo successfully master the content 
develop the cognitive ski Is they will need succ a Engineering). The 

of the course (e.g. .problem ^olv ng |kill^ °^ ^S"r?e2ti ve"feedback to the 
third variable. TESTING, can be used to ,ro students have this kini 

students instead of using it o"yto assign graa^ ^^^^ 
of frequent feedback, ^loom claims that up t^ ?ERSoSaLITY. can be changed if 
successful in a course. The fourth vari^able.^K^^^^ ^^.^ ^^^^^ ^^^^ ^ 
the instructor changes the teaching les r.ing wru variety, frequency and 
increasing the cues to important materia [ 9,J5'';^„JJ^VagiSg student 

quality in the reinforcement 9^ ^^J". 'earing prog^^^ ^.t West Virginia 
participation. Data collected from an JP91"^^"5ables\s indicated above 
SnHersity indicates that manipulating ^%^^;;*°J'nclus1ons. Wales & Nardi 

should not be a deterrent" (p. 340). 

in the end. th/ effectiveness of an ins^^^^^^^^^ 
method appears to depend upon the obje^^^^^^ ^j,atever 
important to note, however, that Jassively attending a class, 

method - are learning more than those w^^^^ document is to determine 

Yhe major purpose the stuOy being reported in ^^^ge urtiverSity classes 
to what extent st^dants are being Jnvo ve^^^^ attitudes and 

and whether that involvement mak«^ a difference 
performance in those classes. 



\ 

Methods 



Objectives 



This study -as conducted Pn^»rlly to accu^uUt^nd co^^ ^, 
observatio-al data """^"1"? /'^^ data. Shich were 

raf.eJfd=^as^rnrp=alrrf%1ar4r"2-Pr^ri'rdhues aU the types of 



interaction patterns which encourage student participation. Because the 
learning research definitely indicates that students learn more if they are 
actively involved in the learning process, ways need to be found to involve 
is Such as possible in !h^se large classes. By using an o Jective 
observation system to verify what, actually happens in these large classes we 
will then be in a better position to prescribe changes which will enhance 
student participation and, thus, their learning. 

Instrument Development 

The pr^iitary instrument which was used to gather data during this study was 
an exoansion of the Cognitive Interaction Analysis System (CIAS which was 
oVidSallJ deJelopId hy Dr. Glenn Ross Johnson (1978) at Texas A&M University. 
jShnson' 5 original instrument consists of 10 categories into which the verbal 
interactions Shtch occur in a classroom may be coded (see Table !)• »of ^ 
more detailed description of the interactions was needed by the staff of the 
Ce^Lr for Teaching Effectiveness to provide both a more complete picture of 
what was taking ilace in the classrooms of clients (for consultation purposes 
a^d t^Issfsl in determining the. quality as well as the quantity of the verbal 
activities which took place in the classes being observed for this study. ^ The 
fiJal sy"em which was developed consists of the basic ten categories with the 
addition of 35 subcategories (see Table 2). 

Tn ralculate the i nter-observer reliability of the adapted. CIAS, two 
obserIerrwe?e'trarnld'?n ns use using a programmed workbook and an audio-tape 
(which were developed for this purpose). Jfter approximate y 10^^^ 
traininn/oractice the two observers were obtaining reliabi lity agreements or 
!5o rove?! During the summer and fall of 1979 this observation system was 
tested to determine its usefulness in the observation and analysis of large 
cllsles! The SJdinator of this study. Dr. Karron Lewis, and one trained 
obs""; coded the verbal interactions in the following classes: 2 Chemistry 
Jlllsef 1 General Studies class, 1 Radio-TV-Film class, 1 History class. 1 Art 
H s?o?v'class and 1 Music Appreciation class. It was determined from these 
Sise?;at5ons and subsequent ?Snsultations with the instructors that the 
Expanded CIAS was definitely a useful tool for the ^"-depf analysis of 
classroom interactions in large university classes. For the La£g| Cl|ss 
Analysis Project two additional observers were trained in "AS observation and 
SfHf SiTques. At the end of the one-week training Pe^-^od these 
observers were obtaining reliability agreements of .80 or over between 
themselves and with the two original observers. 

To obtain information concerning the attitudes of the students in these^. 
larae classes a Student Attitude Survey was also 'developed for the larger stu ay 
mentioned above). Item #9 on this instrument surveyed the students' attitudes 
SSrd the particular large class in which the survey was conducted. The ^ 
* !^-«„c f,.om thit itPm will be refered to several times throughout this report 
ti^^S? d^^ddU Sn rin?imation!''u? you are interested in finding out more 
aSoSr^he larger study, please feel free. to contact Dr. Karron Lewis.) 



nh«;ervation and Data Col 1 ecti on . Sequence t 

To enlist the help of instructors who teach large classes at the 
Universi?? if Texis atVstin, letters .were sent to 120 faculty members in the 
cSlleges of Liberal Arts, Natural Sciences, Business, and Engineering, 



TABLE I 




TEACHER 
TALK 



4. 



Positive re inforcement . Praising students; communicating 
rdlflnuSvalue Judgme nt indicating that the i^^^^^^^ 
really likes what the student said or did; Excenenti 
"Very good!" 



rnrr^ctive/feedback . Includes "^gative statements which 
are nonpunitlve and nonthreatening; saying "no or yes 
or "that's correct" 1n a manner that provided' feedback 
tl students; repeating a student's response so all students 
know the answer w as correct or acceptable. . ' 

Questions . 'Includes rhetorical questions; all questions 
Slaised by the teacher; calling on student by name to 
respond to a question. 



6. 



8. 



STUDENT 
TALK 



ProvidinqcuMZdirSCtloni. Words that signal i/portance. 
^This is important to reme mber." "These next four items 
aJe very mpo"ant in our study." Directions, the Instruc- 
t?r exSects the students to follow; includes procedural 
directions. 



Criticism . Negative, puni.tive 
blaming st udents; saying "Ridiculous" or 
or "Don't interrupt me when 



comments; strong criticism; 
"That's silly" 
I'm giving my lecture." 



rnnn-i t,ive Student talk. Talk by students which subject- 
ma tter oriented; recal ling facts; responding to teacher 
qSes?ions 0? directions with subject-matter responses or 
^Mhi-ect-matter questions; expressing opinion or ideas about 
topics undeJ st2dy' analyzing, synthesizing, evaluating; 
subject-m atter questions raised by students. 

and didn't have time to prepare my lesson. 



TABLE I 
gxpandad CIA S Catanorlas 



- Accepting Student Attitudes 
Ih - Humor 

- Positive Rainforcamant 

2f - Affective Instructor Comments 

- Repeating a Student Response 
3f - Corrective Feedback 

3b - Building on Student Response 

- Questions 

4c - Knowledge/Comprehension 

4q - Application (Examples) 

4a - Analysis 

4y - Synthesis 

4j - Evaluation/ Judgment 

4f - Affective - 
4s - Process or Structure 
4r - Rhetorical 
4p - Probing 

4d - Calling on a Student 

^ ' Sv^-^Simultaneous Visual and Verbal Presentati 
5e - Examples, Analogies 
5r - Review „ 
5x - Answering a Student Question 

5m - Mumbling 

5t - Reading from Visual or Text « , 

5 - Providing Cues ^ 

6m - Focusing on Main Points' 

6d - Directions 

5s - Assignments, Process 

7 - Criticism 

8 - Cognitive Student Talk . 

8c-as - Answers to Instructor Questions 
8n - Doesn't Know 
Sq - Student Question 

8h - Student Laughter 



9 - Non-cognitive Student Talk 

0 - Silence . ^ ^ ^ n • 

Ob - Writing cr ''card without Talking 
Om - Mumbling : -neral low roar) 
01 - Listening/ watching 



A?ta and 2 from englnsarma). (ThU low rmponss rata rslnforoas tha 

Jhat Dortion of th^Urger Thay did, however, allow an obgerver to 

r«2or5 the inter 2tli^^^ took pla'ce In their claaarooms and provided 
SoplSs of an exams, homework, etc. for cognitive level analysis. 

Each trained observer attended from 1-4 courses throughout each semester. 

cuss was observed at least 13-14 times over the course of the semester. 
HAS Codjm; and Compiling Procedures ^ 

aid in a 80-mrnu?e class approximately 1250 categories would be recorded. 

matrirrhl%lrtej2r?lst%«^^^ 

^"^^^^^^^^^^^^^ 

S'quesiiin's): anTll'(Jb ^'Jriting on board or overhead without talking). 

» To compile and analyze these data a computer 
assistance from -the Computation Center. ter the data^e^ 
program gener^^ sSSweS the 'totals for 

'"'^'"'S'^^t^J^S^ielf as thi Je?2^ Jf the total tallies for each category 

students were^asked to respond 



CENTER FOR TE/\CHINS EFFECTIVENESS 
CLASSROOM OBSERVATION FORM 

1. THE COURSE, Numbar;_ TUlai,, ,, „ Meeting mm 

2. LEVEL. Freshman Sophomors Junior Senior Qraduata 

3. CLASS. S129: Description of room.: — , 

^ Where students jjongregate: 

4. SUBJECT FOR THE HOUR..,, 

5. METHOD: 

6. THE INSTRUCTOR. 

Speaking style: 

Use of Movement/Gestures: 
Use of Media: 
Enthusiasm: 

Handouts: 

7. THE STUDENTS. 

Attentiveness (beginning vs. end): 

Questions: 
_Evldjance - (^f-Urtdersta TTdf 

Notetaking: 

8. GENERAL COMMENTS. 

FIGURE 1 --Classroom Observation Form, 
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INTEtolQN ANALYSIS 



14/ 











6 


VI 


n 

VI 


0 


0 


3 


13 


4 


Q 


U 


2 


8 


Q 




0 


40 


2 


7 


0 


39 


0 


0 


0 


8 


0 


0 


0 


- 0 


0 


21 


30 . 


2 


0 


0 


0 


0 


0 


1 


1 


19 


0 


0 


0 


0 


1 


1 


0 


11 


0 


1 


1 


0 










5 , 


47 , 


,47 


137 


.3. 


3.3 


3.3 


9.5 



10 



1/ . 2 0 Q ^ i i n 0 0 0 0 S 0 2 

2/ 0 3 13 . 4 20 0. 0~ 0 g g g 5 0 I 

3/ 0 U 2 8 ■ 19 2 § gj 0 35 0 1 3 I 

5/ 2 7 0 39 530 31 0 2 u u ^ ^ 

6/ 0 0 0 5 29 136 , 0 V I y 5 J 0 0 0 

2 4 3S ■ •. I I \ I I I I I 

^ I I ? 1 4 ! S "o § § s s 



13/ 0 1 .1 0 0 ° " - " 5 12 0 24 



A 


10 


11 


12 










0 


0 


0 


s 


0 


0 


0 


3 


0 


30 


0 


1 


0 


u 


0 


35 


0 


6 


1 


7 


0 


0 


0 


0 


0 


3 


0 


0 


0 


0 


0 


0 


0 


16 


0 


0 


0 


0 


0 


0 


0 


0 


0 


86 


0 


0 


0 


0 


0 


0 


0 


12 


0 


66 


1 


149 


0 


4.6 


.1 


10.4 



U 14 



SUM » '• ggg. igo 0 69 0 66 1 149 S 55 

. -1" ^6.4 13.2 0 4.8 0 4.6 .1 10.4 .3 3.8 

; ,»i m*o*/f ************ 
TOTAL ENTRIES: 1439 
I TT: 86.449 
.% ST: 5.142 
%. PSSR: 10.811 . 
% TSSR: 64.228 

% ID : .19 1 • 

^xi**************** ' * 



' FIGURE 2 - Computer-generated -CIAS matrix. 
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Results 



overall ^ea" Percentages The overall ^ean percentajes^f^^ 
categorTes-arFlTiown in ao.e ^ and Figure 3. as categories 5 ^ ^ 

university class, the bulk of the class ^^[fe^^^^^e^acti^ns which occurred least 
(Lecture) and 12 (Lecture with visuals). .J^J.^JJ^^.t^^e^'student talk) and 
frequently are represented by Category 9^ ^^^^ categories is 

i^t^gfrlfiriserofre'cla^; ^r.e'^llust^rverall , tXe a.ount of student 
participation is quite limited. \ 

Bv college. One of the goals of the study was to determine whether 
instrS^tlS^ ifferent disciplines use,^ ^^^^ 

interactions. As you can see in Table 4 ana category by the 



are: 

Category 



ory 5 (Lecture, - The i '^.''l^SSn ^^'Zt X'l^^'" 

^^iSBsm^^^ : 

category 8 (Cognitive ""f ".f.niSk^tl'r.'flJSraril^^HarlrciSa^f 

it is noteworthy that the students in uidb colleges. Even so, 

ST-oVVe'tSt^ ^^\^m^ .rJ dea, .Of, ... 

Student participation. 

category 10 (Silence)"- There f P":%?5s«s1n"the\"tSe? lluiW" This 

a result of instructor pauses during the lecture. 

category 12 <l;rrIS?,irte|ry^Sr"f lSrtr°JtS^I"?i'ia-tuS^ 'S^^lo 
"glnr^g^JarU ac^^ed 'for primarily In their writing on the 
board and talking at the same time. 

category 14 (Writing on the «J',|;°;'Eng?Jerr?Jg\erd'"'ure%he 

i^xrrd%raTs:a 3 « 
Sd^riXVrjtrrt^^^^^^^^^^^^ 

l::5?rh"i^irrrd rurte''fr:g:°eS?;,''rd:fin1tely undesirable In large 
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TABLE 3 

Overall Means for CIAS Categories 



Teacher Talk 




Student Talk 




Silence 




Cateqor/ 


Mean 


Category 


Mean 


Cateqor/ 


Mean 


1 


.77 


8 


2.93 


10 


5.03 


2 


.99 


9 . 


03 




1 . 


3 


2.18 


13 


2,06 


Total 


6.36 


4 


3.12 


Total 


5.02 






5 


52.59 










6 


8.94 










7 


.04 










n 


.90 










12 


18,93 










Total 


88.46 











1 




Accepting student attitudes 


2 




Positive reinforcement; affective instructor comments 


3 




Repeating a student response; providing corrective feedback; building 
on a student response 


4 




Questions asked by instructor 


5 




Lecture 


■6 




Providing cues; focusing on main points; giving directions; assign- 
ments, process 


7 




Criticism 


8 




Cognitive student talk 


9 




Non-cognitive student talk 


10 




Silence; listening or watching 


11 




Teacher use of humor 


12 




Simultaneous visual and verbal presentation 


13 




Student question 


14 




Writing on board without talking 



11 



14 



Overall percentage means for CIAS Categories 




10 11 12 13 1* 



Category 



1 • 

2 - 

3 • 



4 

5 
6 



Accepting student attttudes 
Positive reinforcement; 
affective Instructor cownents 
Reoeattng a student response; 
providing corrective feedback; 
building on a student response 
questions asked by Instructor 
Lecture 

Providing cues; 
focusing on main points; 
giving d1 recti ons, assignments, 
process 



7 • Criticism 

8 « Cognitive student talk 
9^- Non-cognitive student talk 

10 - Silence; listening or watching 

11 - Teactter use of humor 

12 • Simultaneous visual and verbal 

presentation 

13 - Student question ^ 

14 • Writing on board without talking 



FIGURE 



3 - Overall percentage means for CIAS categories. 
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TABLE 4 
CIAS Means by College 



Category 

1 

Z 

3 

4 

5 

6 

7 

8 

9 

10 
11 
12 
13 
14 



Nat. Sci . 

.69 
.95 

1.22 
3.21 
42.20 
9.76 

.03 
1.63 
. .02 
2.98 

.71 
33.31* 
1.07 
12.83* 



Enqineering 


Business 


Liberal Arts 


096 


1.14* 


.83 


68 


.99 


1.08* 


4 09* 


1.33 


2.86 


7 10 

^ • 1 VJ 


3.33* 


3.25 


10 


60.20* 


59.90 


in SI* 


8.12 


8.38 


IQ* 


.04 


.009 


1.92 


2.56 


4.36* 


.01 


.07* 


.02 


10.75* 


5.04 


4.85 


.50 


1.29* 


.92 


29.18 


13.27 


8.61 


2.76* 


2.39 


2.29 


1.04 


.04 


1.61 



*Highest mean percentage for each CIAS Category. 

\ \ BB^s^'^'^'s^-^''^'-- ....... 

on a student response 
4 - questions asked by instructor 

^ 6 : PrfviStng cues; focusing on main points; giving directions; assign- 
ments, process 

7 - Criticism . 

8 - Cognitive student talk 

9 - Non-cognitive student talk 

10 - Silence; listening or watching 

11 - (Ih) - Humor ^ ^. 

12 - {5v) - Visual and verbal presentation 

13 - (8q) - Student question ^ ^ • 

14 - (10b) - Writing on board without talking 
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16 



classes because the students in the back of .the room cannot hear what 
ilbling said unless the instructor .s wearing a mike. 

^ntprpstina to note (though not unreasonable to expect) that as the 
average ilalfsUe de?re°asrs! the aJunt of student participation increases: 



# Classes of that size 



90-140 
141-250 
251-350 













by College 




Avg.%ST 


Min»T/T 


Min.MWF 


LA 


E 


B 


Total' 


6.08 


4.86 


3.04 


4 


1 


3 2 


10 


5.12 


4.10 


2.56 


2 


1. 


1 1 


5 


2.53 


2.02 


1.27 


1 


0 


1 2 


4 



By instructor - ratin^s^ As noted before, the average^amount of^time^^ ^ 
spent-Tn-eicrrmegorT^TTTot show a dea i ^^^^^ ^^^^ 

college. However we were also JP^erested " seei-ig ^^dicaled by the 

differences which distinguished the ^^^^^^^g^gd so highly by the . 

Student Attitude Survey) ^';°'"^J5j^S,^5?s^?J%?SdeJr rankings' (Inmost effective 
students. Table 5 l^^ts the instructor^ ^^^^ percentages for 

??^;^r5?gS^?gS5%r^? tK f?nSl^oi iur analysis bf these 



data. 



The average percentages of teacher ^^J^^ ^J^f.^ori^elrs'thai'tSeJe'?! So't a 
instructor are shown first i^ of time they spend 
great deal of difference among the instructors in Lne amuu 



^itern 9 on the Student Attitude Survey: 

How did you enjoy attending this class? 

Very much No^ all 

1 2 3 4 5 



TABLE 5 

Mean Percentages for CIASiCategories by Instructor Rank 





Instr. 
Rank 


Subj. 


Rating 


Class 
GPA 


#Stu. 


% TT 


% ST 


1 


2 


3 


4 


5 


6 


CIAS 
7 


Catec 
8 


)ory 
9 


. 10 


11 


12 


13 


14 




1 


Anthro. 


1.355 


2.74 


130 


86.3 


8.5 


0.1 


2.4 


0.5 


2.6 


70.1 


5.6 


0.0 


5.1 


0.0 


4.7 


1.6 


3.5 


*% A 

3.4 


n c 

0.5 




2 


Soc. 


2.000 


2.32 


200 


85.4 


5.5 


o.z 


1.5 


A n 
4.0 


O 1 


CI 9 


y .5) 


n n 


H.J 


n n 

U.U 


ft 1 


n 1 


4 7 


1 7 

X « C 






«3 


UOV L • 


C . uuO 


7 on 




7Q Q 


10 4 


0 1 


0.9 


3.3 


4.3 


53.6 


8.9 


0.0 


5.4 


0.1 


8.3 


1.3 


2.1 


4.4 


1.3 




A 

H 


tur sy . 




9 m 


on 


Rn R 


7 7 


0 1 


0 9 


2 5 


1.9 


54.1 


9.4 


0.0 


4.1 


Xo 


7.5 


0.4 


11.3 


3.6 


4.3 




0 


Astr. 


9 1 AO 


9 An 


9nn 






0 R 


1 4 


2 4 


4.4 
• • • 


52.9 


11.5 


0.0 


2.8 


0.0 




0.9 


21.8 


1.2 


d.3 




6 


H.E. 


2.211 


2.87 


140 


96.1 


2.4 


2.2 


2.5 


1.4 


i.2 


67.3 


10.2 


0.0 


1.2 


0.0 


1.4 


0.1 


10.3 




n 

O.U 




7 


Hist. 


2.228 


2.17 


300 


98.0 


1.3 


4.2 


0.4 


0.4 


1.5 


On o 
oO. C 


9.0 


n n 
U.U 


U. 3 


n n 

U.U 


U.U 


1 7 


n 1 

li . X 


n Q 


0 0 




o 

O 


H.tng. 


c. Jo J 


9 ni 


1 An 


7Q 1 




n n 


n 6 


5 9 


2 7 


44.7 


8.6 


0.3 


2.6 


0.0 


15.1 


0.6 


15.6 


3.0 


0.1 




9 


Calc. 


2.574 


2.18 


130 


85.1 


3.7 


0.1 


0.9 


0.7 


3.5 


20.^ 


in 7 


U.U 


9 1 


n n 


A 9 


n A 


4fl 9 
HO ■ c 


.X • o 


5 3 


• 


1 n 

10 


Adv. 




9 7Q 


1 /in 


7Q A 




n 1 


1 n 


0 1 


2 4 


51.7 


8.6 


0.1 


3.3 


0._2 


U.3 


LI. 


12.3 


3.6 


0.2 




11 


Mark. 


2.711 


2.95 


350 


82.2 


5.7 


0.1 


1.1 


0.3 


2.3 


60.1 


7.6 


0.1 


1,1 


j O.Z 


12.1 


2.5 


8. 1 


4.0- 


-U.U 




12 
13 


E.Eng. 

I .Bus* 


2.830 


2.74 


250 


89.1 


3.5 


0.2 


0.9 


1.7 


1.3 


24.8 


13.2 


0.0 


1.0 


0.0 


5.1 


0.3 


46.8 


2.5 


2.3 




O QIC 




1 in 
liu 


34. O 


d 4 


c» c 


0 R 


2 2 


1.9 


63.7 


9.6 


0.0 


3.2 


0.0. 


0.7 


1.2, 


13.2, 


1.2 


0.0 




14 


Acct. 


2.991 


2.37 


ZOO 


96.1 


2.1 


1.9 


1.8 


1.4 


6.7 


57.1 


^.0 


0.0 


1.5 


0.0 


1.8 


0.6 


19.0 


0.6 


0.1 




-15 


Insur-. 


-3.Z66-_ 


^Z.39_„ 


__i2o:^ 


94.7 


5.0 




0^3^ 


2.4 


2.9 


67.0 


5.4 


0.0 


2.5 


p.o 


0.3 


0.9 


14.9 


2.6 


0.0 




16 


Eco. 


3.302 


1.47 


120 


85.5 


11.6 


0.9 


0.7 


6.6 


5.6 


34.2 


7.0 


0.0 


9.0 


0.0 


0.7 


0.1 


29.5 


2.6 


2.3 




17 


Eco. 


4.056 


1.83 


130 


92.7 


3.2 


0.1 


1.1 


2.6 


5.5 


62.9 


8.1 


0.0 


2.8 


0.0 


2.0 


0.2 


12.2 


0.4 


2.1 
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Figure 5 - Average percentage of teacher talk by instructor • 



taumg. the four M9h«t-r.ted instructors spend less_^ti^^ ^ 
most of the instructors who were '"f'^ed lower. '"^^J J 

percentages for all of the instructors ;rojJ,9/.2% Jor the 8th^ ^^^^^ 

instructor to 98.0% for ^^^^^.^^.^^^.'^/^"sfiS^^e n an 80-minute class it would 
amount to 9.4 minutes in a SO-minute class wm le in a 

be 15 minutes, 
examined below. 

„rst. When we compare the ^-^Sftrrs^^rfrn/r^r^etrS 17.?:^^'^^ 
?J?5'u?e-7"a'b)°"^Jrraro"dff?e;"eS«f JmcS TJI. observed are that: 

r^j^^t'si^J^^ rthr?«t°'rar.r= 

instructors and, even more noticeable, 

(2) the foun lowest-ranked instructors lecture much more with visuals than 
do the four highest-ranked instructors. 

Bv studying the actual coding data we discovered that the silences in the 
-four Mghest*raSked instructors' cla««-^eeur primarily 

X. after an instructor asked a question (to provide "think time" for the 
Students), 

9 .fter the instructor had stressed something which was important (to 
grve tSe stSts time to write it in their notes), ^ 

3 after an instructor had given directions or an assignment (to provide 
?ime for the students to do what has been asked). 

The infrequent periods pf silence which occur in the four lowest-ranRed 
instructors' classes usually occurred... 

1. during the lecture (as if the instructor werex searching for words to 
continue) , 

2 after the instructor had placed an overhead t^an^^^ency on the 
■ fverhead^(to allow students 

- 3. when handouts/homework/exams were being passed in or returned, and 
4. when students.were copying assignments which had been written on the 
board. 

• AS you can see, the silences occurred under^f airly diff^^ 
the former appearing more frequently m the classes nig 
instructors. -~rr- ■■ 
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Figure 6 - Average percentage of student talk by instructor. 
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instructors. 



p ercentages in each CIAS Category for the four highest-ranked 
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Instructor ranks: #14 - 



5 6 7 8 9 
CIAS Categories 

; #15 ; #16 ; #17 



Figure 7(b) - Mean percentages in each CIAS Category for the four lowest- ranked 
instructors. 




«... ...u/d expect the students to tee. ^"^^ at the different ways in wh4ch 

visuals were used primarily to.. . ^, 

1. illustrate a concept (e.g.. a film, slides, sample problems) or 

: fi'tc • ) • \ . 

On the'other hand, in many of the lower-ranked classes... 

same manner. ) 

She1h"s?nSsft r«c? ..ably or negatively to their use.- ^ 
n,. in.friirtors we obse. vi showed a definite preference for either 

,ectuH^;:^t:r^royisuals^orwitho^^h^ 

;Xrro"u"cI"see: '.n?rt7e Uroxi^ately e<,ual ^ 

/ amounts of each method. . , • , - 

asking questions. ^Jf.^f.JfJ^lertKatThe qSestfons JhTch'^were asked by these 
and/or comments. This l"di"tes that tne ques _ the students . 

instructors were at higher cognitive levels, an^ students- in all but 

- ?L^?Sfr^ow s^^ln er 1 -t^^ little when compared to 
The tSe amount of t?me the instructors spent asking questions. 

AS each observer was coding the classroom i"^^''^^^!^"^ .f/ ^'^^ " 
levels of the questions asked by each instructor were recor^ 
that the most frequently ^^^^^^^^f,;- / ^the hLdoutT") o 

"Do you need more time? .Does everyone nave Jjpothesized. most of the 

^ulrt^i^s^ieaSfnrdl?-tlriith°^he^ii^tt^t^on^? required the students to 
respond at the knowledge/comprehension level. - 

- -~ -Fre,uently-.e-hear-thatJt is t^^^^^^^^^ 
rr"da11rthlt1sn'rn«e:?a:^?5 the^e is a fairly 



22 



0) 

cn 

c 
<u 
u 

a> 
o. 



80- 

75- 

70-- 

65-- 

60-- 

55-- 

50 

45 

40 

35 

30 
_25 

20 

15 

10 




\ I- 
i f 



-I 1 1 1 > I 



-! 1- 



H i- 



[ 2- 3 4 5 6 8 9 10 11 12 13 14 15 *16 17 

Instructors by rank / • • 

Category 5 (Lecture) ^ v/' . 

Category 12 (Simultaneous use of visual and verbal presentation; — -- 

Figure 8 - Mean percentages for categories 5 and 12 by instructor rank. 
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Category 4 (Instructor asked questions) 
J. Category 8 (Cognitive student talk) 



, Figu^9 - Mean percentages for categories 4 and 8 by instructor rank. 



4c 4e 4a 4y 

Types 

4c - Knowledge/Comprehension 
4e - Application 
4a - Analysis 
.4y - Synthesis 
4j - Evaluation 

Natural Science 

Engineering 

Figure 10 - Mean percentage 
by College. 



Questions 

4f - Affective 
4s - Process 
4r - Rhetorical 
4p - Probing 

4d - Calling on a student 

Business 

Liberal Arts 

of types of questions asked during class 
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wide amount of variation in the number of humorous statements made by the 
observed instructors with those using the most humor falling in the middle of 
the rankings. 

One would suppose that there would be a discipline problem in these large 
classes! The dlta%raphed in Figure 12. however, indicate that the observed 
instructors spent very little, if any, time criticizing/disciplining the 
stSdeStfl Category 7). It is also interesting to note that there were 
neg?rg?ble aS^s of non-cognitive student talk (Category 9) in these;classes 
and there seemed to be no correlation between the amount of non-cogmtive 
student talk and the amount of time the instructors spent 
criticizing/disciplining. 

Although one might assume that an instructor who provides frequent praise 
and re nfor?ement woQld tend to have more student participation. Figure 13 
nfusTrStes that that may not be the case. As you can see, instructors ranked 
n 6 10 and 14 used more reinforcement than did the other instructors but 
only in the Mse of the #1 ranked instructor did the students participate more. 
Thus, again, the quality of the reinforcement may be more important than the 
quantity. 



Finally, Figure 14 shows the mean percentages for Category 13 (Student 
Questirs). Tliil indicates that the higher-ranked nstructors did more to 
pnrniiraae students to ask questions in class than did most of their 
iSwe^rlnkfd coun?er?a?ts.^ This willingness to answer questions Jlass^is 
oZ of the distingui hing Characteristics of effec teachers as cited in^the 
literature (Eble, 1971; Sheffield, 1974; Smith, 1980). , 

By instructor - first half nf sgmester vs. seco"d ^ia1f. Several trends 
were med when a c omparnsorTof ^e^nearTpercentages of-use from the first and 

wfre arialyzed! fHost of the instructors increased their use of: 

Category 1; (Accepting student attitudes) 
Category 2 (Positive reinforcement) 
Category 9 (Non-cognitive student talk) 
Category l|; (Student asked questions) 
and Category 10 (Silence) • - 

• It aooears that the use of the first three categories listed above depend on 
the iSstJucSrand students getting to know each other, and. thus becoming 
Smfirtab^e SnS these more personal interactions. On the other hand, 
decreases were found in the instructors use of: 



Category 3 
Category 6 
Category 8 
and Category 11 



i(RepeLting a" student response, providing corrective feedback) 
(Providing cues, giving directions) 
(Cognijtive student responses) 
(Use of humor). 



Cateaories 3 and 6 were used more at the beginning, of the semester to help 
auidP the students; this probably didn't seem as vital in the second half of 
c JpctPr Ckeaorl 11 was used more at the beginning of , the semester to 
treir^hrJce.TAnrift^ 



"tfe mest r rog es^ e b;i;ure1nstructirrfound themselves falling behind 
?n "covIrinrthe]conteni'' so they allowed less time for student interactions. 




Instructors by rank 



Figure 11 - Mean percentages for Category 11 (Humor) by instructor 




H 1 1 > H 

9 10 11 12 13 14 15 16 17 



Instructors by rank 

— — Category 7 (Criticism) 
Category 9 (Non-cognitive student talk) 

Figure 12 - Mean percentages for Categories 7 and 9 by instructor rank, 
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Instructors by rank 



, Category 8 (Cognitive student talk) 

Category 2 (Positive rernforcement): 

Figure 13 - Mean percentages for Categories 2 and 8 by instructor 
rank. 
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Figure 14 - Mean percentages for Category 13 (Student asked .questions) 
by instructor rank. 
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(A noteable exception 13 Illustrated 1n Figure 15 where we found that the 
lSoJ« ff cogHrtlve student talk Increased In the two highest rated classes.) 



The use of 



Category 4 (Instructor asked questions) 
Category 5 (Lecture) 

lz%ZnZLs use of visual and verbal presentation) 
and Category 14 (Writing on the board or overhead without talking) 

remained constant over the semester. 

the viblfStlo^l^fS^v^Iro^^?!^ 

?han do instructors teaching upper-division courses (Table 6). 

Category 3 (Repeating student response; providing corrective feedback; 
building on a student response) 

'ilZ'Z 6 S?r'o:;'dlSrc'u;°sr)ocus1ng on ™a1n points; g1v1n, directions; 

assignments, process) .«„^.:.+^„n^ 
Cateaorv 12 (Simultaneous visual and verbal P/esentation 
and zlllllr:/ 14 (WrUing on the board or overhead without talking). 

rn^nii^ rgvels of Instructors' Evaluative Instruments, 
Business and Engineering. 

cognitive processes feel those courses -are more effective. 
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10 11 12 la 14 15 16 17 



Instructors by rank 

First half of the\sentester 

Second half of the "^s^mester 

Figure 15 - Mean percentages foK Category 8 (Cognitive student 

talk) for first~and-s'fe^ond-ha-l-f-o^^the-semeste^ 

by instructor rank. 




TABLE 6 



One-way ANOVA of Mean Frequency of Use for Each 
eiAS Category by Course Level 



Cateqory Lower-Division 


llnnpr*«ni\/i si nn 


Fvalue 


p 


1 


.8355 


.6867 


• .494 


.48 




.8673 


1.1444 


3.699 


.0559 


*3 


2.6309 


1.6356 


4.255 


.04 


*4 


3.5100 


2.6467 


6.313 


•U 1 


*S 


48.1845 


57.9789 


13. Zoo . 


• UUU4 


*6 


.9.5527 


8.1967 


5.904 


.02 


7 


.0527 


.0278 


.8979 


.34 


8 


2.8536 


3.0289 . 


.152 


.70 


9 


.0227 


.0367 


.476 


.49 


10 


4.8611 


5.2289 


.076 


.78 


11 


.8627 


.9400 


.356 


.55 


*12 , 


22,1345 


14.9478 


8.833 


.003 


13 


1.8345 ■ 


2.3411 


- 2.747 


.10- 


*14 , 


1.6382 


• .9456 


5.9739 


.02 


♦Significant 


difference at p 


5 .05 






AApproaching significance. 









Cognitive UveU Tasted by Instructor/Enjoyment Rating 



CO 







Type 




f 






% Given 




Aun 


I lis tr. 


Cognitive Uveli** 








Dn/iiif MA/I*) 




A 

n 


n 


C 


P/f, 






CqUq 






An A in 

M 




1. 


1.3S4a 


u 


N 


130 


20 


35 


26 


5 


6 


2.74 


20 








X X. 


2. 


2.0000 


u 


N 


200 


8 


20 


22 


11 


24 


2.32 


24 


X 


X 




X X 


3. 


2.0057 


L 


R 


220 


27 


43 


16 


8 


M 


2,90 


25 




X 


X 


X 


4. 


2. 1186 


U 


N 


90 


20 


23 


26 


13 


9 


2s51 


27 


X 


X 


X 




5. 


2. 1608 


L 


N 


200 


13 


29 


35 


14 


1 


2.40 


12 




X 


X X 




6. 


2.2110 


U 


N 


140 


26 


43 


16 


5 


9 


2.87 


11 


x 


X 






7. 


2.2281 


L 


R 


300 


10 


30 


31 


21 


- 


2,17 


20 






X 


X X 


a. 


2.3026 


L 


R 


140 


10 


30 


28 


29 




2.01 


13 


X 


X 


X 




9. 


2.5739 


U 


R 


130 


18 


21 


30 


27 


1 


2.18 


IS 






X 




10. 


2.7059 


U 


N 


140 


13 


54 


CD 


J 




2.78 


17 


w 

A 


f% 






11 


2 7113 


II 

u 


n 


350 


32 


36 


23 


5 


1 


2.95 


22 


X 


X 


X 




12. 


2.8296 


L 


R 


250 


30 


32 


17 


14 


1 


2.74 


29 


H 


X 


X 




13. 


2.8356 


U 


N 


110 


13 


28 


31 


11 


3 


2.47 


26 


H 


X 


X 




14. 


2.9914 


U 


R 


ZOO 


9 


36 


31 


15 


3 


2.37 


21 




X 


X 




15. 


3.2658 


U 


N 


120 


12 


31 


36 


13 


3 


2,39 


14 


X 


X 


X 




16. 


3.3016 


L 


R 


120 


6 


12 


22 


44 


2 


1.47 


23 




X 


X 




17. 


4.0561 


L 


R 


130 


10 


12 


33 


38 


1 


1.83 


16 


X 


X 


X 




18. 




U 


R 


300 


13 


19 


31 


18 


1 


2.23 


18 






X : X 




19. 




L 


R 


300 


8 


28 


37 


16 




2.23 


19 


X 


X 


X 





_*Type Class 

U = Upper division - Jr/Sr 
L = Lower division - Fr/Sopi» 



**Cagnl-tlve_Leyel&_- 
K - Knowledge 
C - Comprehension 
Ap - Application 



\n - Anarlysis 
I S - Synthesis 



Evaluation' 



Discussion 



Because it appears that Urge cUsses JJJ 9«^;9 to JiJ J P^"^* «f f « 

tachnlquas used in smaner classes can be transferred to large grouw- 
instruction. 

This study has given us some "hard" data concerning some ;J ^^^.J^cHnlques 
memorize. 
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